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Abstract 

We study the usage of regularity properties of collections of sets in con¬ 
vergence analysis of alternating projection methods for solving feasibility 
problems. Several equivalent characterizations of these properties are pro¬ 
vided. Two settings of inexact alternating projections are considered and 
the corresponding convergence estimates are established and discussed. 
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1 Introduction 

In this article we study the usage of regularity properties of collections of sets 
in convergence analysis of alternating projection methods for solving feasibility 
problems , i.e., finding a point in the intersection of several sets. 

Given a set A and a point x in a metric space, the (metric) projection of x 
on A is defined as follows: 

Pa(x) := (a £ A | d(x, a) = d(x, A)} , 
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where d{x, A) := mt ae A d(x, a) is the distance from x to A. If A is a closed 
subset of a finite dimensional space, then Pa{x) ^ 0. If A is a closed convex 
subset of a Euclidean space, then Pa(x ) is a singleton. 

Given a collection {A, B} of two subsets of a metric space, we can talk about 
alternating projections. 

Definition 1 (Alternating projections). {x n } is a sequence of alternating pro¬ 
jections for {A, B} if 

X2n+1 £ P B (x 2n ) and X2n+2 & PA(X 2 n+l) (n = 0, 1, ...). 

Investigations of convergence of the alternating projections to a point in the 
intersection of closed sets in the setting of a Hilbert space, or more often a finite 
dimensional Euclidean space, have long history which can be traced back to 
von Neumann; see the historical comments in mmm- In the convex case, 
the key convergence estimates were established by Bregman |B] and Bauschke 
& Borwein [3j. In the nonconvex case, in the finite dimensional setting, linear 
convergence of the method was shown by Lewis et al. pa Theorem 5.16] under 
the assumptions of the uniform regularity of the collection {A, B} and super¬ 
regularity of one of the sets; see the definitions and characterizations of these 
properties in Section [2] 

Throughout this paper, we assume that A and B are closed. 

Theorem 2 (Linear convergence of alternating projections). Let X be a finite 
dimensional Euclidean space. Suppose that 

(i) { A , B} is uniformly regular at x € An B, i.e., 

c := sup {— (u,v) \ u€ Na{x) flB, v € N b{x) Dl} < 1; (1) 

(ii) A is super-regular at x. 

Then, for any c € (c, 1), a sequence of alternating projections for {A, B} with 
initial point sufficiently close to x converges to a point in A n B with R— linear 
rate yfc. 

Na(x) and Nb(x) in (JTJ) stand for the limiting normal cones to the corre¬ 
sponding sets at x ; see definition m below. 

Observe that — {u, v) in m can be interpreted as the cosine of the angle 
between the cones Na{x) and —Nb(x). 

The role of the regularity (transversality-like) property (i) of {A, B} and 
convexity-like property (ii) of A in the convergence proof is analysed in Drusvy- 
atskiy et al. m and Noll & Rondepierre [22] . It has well been recognized that 
the uniform regularity assumption is far from being necessary for the linear 
convergence of alternating projections. For example, as observed in m, it fails 
when the affine span of A U B is not equal to the whole space. 

The drawback of the uniform regularity property as defined by m from the 
point of view of the alternating projections is the fact that it takes into account 
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all (limiting) normals to each of the sets while in many situations (like the one 
in the above example) some normals are irrelevant to the idea of projections. 

Recently, there have been several successful attempts to relax the discussed 
above uniform regularity property by restricting the set of involved (normal) 
directions to only those relevant for characterizing alternating projections. All 
the newly introduced regularity properties still possess some uniformity in the 
sense that they take into account directions originated from points in a neigh¬ 
bourhood of the reference point and some estimate is required to hold uniformly 
over all such directions. 

Bauschke et al. |31I5] suggested restricting the set of normals participating in 
m by replacing N a{x) and N B (x) with restricted limiting normal cones N A (x) 

_ A 

and N B (x) depending on both sets and attuned to the method of alternating 
projections. For example, the cone N A (x) consists of limits of sequences of 
the type tk{bk — ak ) where tk > 0, bk £ B , ak is a projection of bk on A, and 
ajt —> X] cf. definitions (HD and ( 1181 ) . Bauschke et al. also adjusted (weakened) 
the notion of super-regularity accordingly (by considering joint super-restricted 
regularity taking into account the other set) and, under these weaker assump¬ 
tions, arrived at the same conclusion as in Theorem[2] cf. 0} Theorem 3.14] and 
Theorem [15] below. 

The idea of Bauschke et al. has been further refined by Drusvyatskiy et 
al. m Definition 4.4] who observed that it is sufficient to consider only sequences 
tk{bk — Ofc) as above with bk —► x; cf. Definition [TPl below. In this case, ak —> x 
automatically. 

In [TO], the authors suggested also another way of weakening the uniform 
regularity condition ©■ Instead of measuring the angles between (usual or 
restricted in some sense) normals (and negative normals) to the sets, they mea¬ 
sure the angles between vectors of the type a — b with a € A and b £ B and 
each of the cones N B ro *(b) and —N A ox (a). At least one of the angles must 
be sufficiently large when a and b are sufficiently close to x\ cf. 10 5 Defini¬ 
tion 2.2]. Assuming this property and using a different technique, Drusvyatskiy 
et al. produced a significant advancement in convergence analysis of projection 
algorithms by establishing (see [TD] Corollary 4.2]) R— linear convergence of al¬ 
ternating projections without the assumption of super-regularity of one of the 
sets (and with a slightly different convergence estimate). The idea is closely re¬ 
lated to the more general approach, where the feasibility problem is reformulated 
as a problem of minimizing a coupling function, and the property introduced 
in m is sufficient for the coupling function to satisfy the Kurdyka-Lojasiewicz 
inequality [2 Proposition 4.1]. 

The two relaxed regularity properties introduced in [TD] are in general inde¬ 
pendent; cf. Examples I2T1 and 1221 

The next step has been made by Noll and Rondepierre [221 Definition 1], 
They noticed that, when dealing with alternating projections, the main building 
block of the method consists of two successive projections: 

ai £ A, b £ P B (a i) and a 2 £ Pa(6) (2) 
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and it is sufficient to consider only the (proximal) normal directions determined 
by ai — b and 6—02 for all a\, b, 02 in a neighbourhood of the reference point 
satisfying ©. In fact, in [2j2], a more general setting is studied which allows 
for nonlinear convergence estimates under more subtle nonlinear regularity as¬ 
sumptions. 

Another important advancement in this area is considering in m of inexact 
alternating projections. Arguing that finding an exact projection of a point 
on a closed set is in general a difficult problem by itself, Lewis et al. relaxed 
the requirements to the sequence {x n } in Definition [T] by allowing the points 
belonging to one of the sets to be “almost” projections. Assuming that the other 
set is super-regular at the reference point, they established in ns Theorem 6.1] 
an inexact version of Theorem [2] 

In the next section, we discuss and compare the uniform regularity property 
of collections of sets and its relaxations mentioned above. Several equivalent 
characterizations of these properties are provided in a uniform way simplifying 
the comparison. 

The terminology employed in mmmm for various regularity properties 
is not always consistent. We have not found a better way of handling the situa¬ 
tion, but to use the terms BLPW-restricted regularity, DIL-restricted regularity, 
and NR-restricted regularity for the properties introduced in Bauschke, Luke, 
Phan, and Wang EE], Drusvyatskiy, Ioffe and Lewis m , and Noll and Ronde- 
pierre |22] , respectively. The refined version of BLPW-restricted regularity due 
to Drusvyatskiy et al. [lOj is referred to in this article as BLPW-DIL-restricted 
regularity. 

In SectionS we study two settings of inexact alternating projections under 
the assumptions of DIL-restricted regularity and uniform regularity, respec¬ 
tively, and establish and discuss the corresponding convergence estimates. 

Our basic notation is standard; cf. [9l f2Tlf24] . For a normed linear space X, 
its topological dual is denoted X* while (•, •) denotes the bilinear form defining 
the pairing between the two spaces. If X is a Hilbert space, X* is identified 
with X while (•, •) denotes the scalar product. If dim A" < 00 , then X is usually 
assumed equipped with the Euclidean norm. The open and closed unit balls and 
the unit sphere in a normed space are denoted B, B and S, respectively. B^(x) 
stands for the open ball with radius 6 > 0 and center x. We use the convention 
®o(x) = {x}. 


2 Uniform regularity and related regularity prop¬ 
erties 

In this section, we discuss and compare the uniform regularity property of col¬ 
lections of sets and its several relaxations which are used in convergence analysis 
of projection methods. 
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2.1 Uniform regularity 

The uniform regularity property has been studied in nuns]- Below we consider 
the case of a collection { A, B} of two nonempty closed subsets of a normed 
linear space. 

Definition 3. Suppose X is a normed linear space. The collection { A , B} is 
uniformly regular at x G A n B if there exist positive numbers a and S such that 

(A-a- x) P)(S - b-y) P|(pB) ± 0 


for all p £ (0, 5), a £ A fl B,s(x), b € B fl Bf(x), and x, y £ (cqo)B. 

The supremum of all a in Definition [3] is denoted 6[A, B](x) and provides 
a quantitative characterization of the uniformly regularity property, the latter 
one being equivalent to the inequality 9[A,B](x) >0. It is easy to check from 
the definition that 


6[A,B](x) 


a 


lim inf 

A _ , B _ . „ 

—*X,b—YX,p\\J 


6 P [A — a,B — 6] (0) 
P 


(3) 


where 

9p[A,B]{x) := sup jr > 0 | (A - x) P|(B - y) P|B p (x) ± 0, Vx,y e rB| 

and a —> x means that a —> x with a £ A. 

The next proposition contains several characterizations of the uniform reg¬ 
ularity property from [141H8] . In its parts (ii) and (iii), Na(cl) stands for the 
Frechet normal cone to A at a 6 A: 

Na(o) := < u £ X* | lim sup ^-p < 0 > . (4) 

l *4a II* "“II J 

Proposition 4. Let A and B be closed subsets of X. 

(i) Suppose X is a normed linear space. 

Metric characterization: 


6[A,B](x) 


lim inf 


z—±x\ x,y—t 0 
z£(A-x)r(B-y) 


max {d(z, A — x), d(z , B — y)} 
d{z,(A-x)f](B -y)) 


(5) 


{ A , B } is uniformly regular at x if and only if there exist positive numbers 
a and 6 such that 

ad (z, ( A — x) f^|(B — y)J < ma ,x{d(z, A — x),d( z i B — y)} (6) 

for all z € Ba(x) and x, y € <5B. 
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(ii) Suppose X is an Asplund space. 
Dual characterization. 


8[A , B](x) = liminf { ||u + u|| | u £ Na{o), v £ ./Vb(&), 
p.J,0 l 

a € Ad B p (x), b £ B D B p (x), ||u|| + ||u|| = l|. (7) 

{ A , B } is uniformly regular at x if and only if there exist positive numbers 
a and S such that 

a(IMI + IMI)<ll« + «ll (8) 

for all a £ A n 8 , 5 ( 2 :), b £ B D 8 , 5 ( 2 ;), u £ Na(o), and v £ Nsib). 

(iii) Suppose X is a Hilbert space. 

Angle characterization. If either x £ bd A fl bd B or x £ int (A n B), then 

6 * 2 3 [A,B](x) = ±(1-c[A,B](x)), (9) 


where 

c[A, B](x) := limsup { — (u, v) | u £ Na(o,) fl S, v € Nsfi) fl §, 
pi 0 l 

a&Ar\Mp(x), b G B fl B p (a;)|. (10) 

Otherwise, 9[A,B\{x) = 1 and c[A,B](x) = — 00 . 

{A, B} is uniformly regular at x if and only if c[A,B\(x) < 1, i.e., there 
exist numbers a < 1 and 8 > 0 such that 

— ( u , v) < a (11) 

for all a £ A(1 8,5(2:), b £ B C I 8,5(2;), u £ Na{cl) fl S, and v £ 1 Vb(&) fl S. 

Remark 5. 1. Regularity criteria © and © are formulated in terms of distances 
in the primal space and in terms of Frechet normals, respectively. This explains 
why we talk about, respectively, the metric and the dual characterizations in 
parts (i) and (ii) of Proposition [4] The term “angle characterization” in part 
(iii) comes from the observation that — (it, v) in criterion m can be interpreted 
as the cosine of the angle between the unit vectors u and —v. 

2. Constant m is nonnegative while constant m can take negative values. 
It is easy to see from © that Q[A, B](x) < 1 if x int (AdB) and 6[A, B\{x) = 
00 otherwise. Similarly, \c[A, B](x)\ < 1 if x £ bd Aflbd B and c[A, B\(x) = —00 
otherwise. 

3. Unlike [T7], we assume in ©, 0, and (flUl) the standard conventions 
that the infimum and supremum of the empty set in R equal +00 and — 00 , 
respectively. As a result, an additional assumption that either x £ bd A fl bd B 
or x £ int (A fl B) is needed in part (iii) to ensure equality ©. 
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4. Equality © was proved in m Theorem 1] while equality © was es¬ 
tablished in [15.] Theorem 4(vi)]; see also (T3J Theorem 4] for a slightly weaker 
result containing inequality estimates. Equality © is a direct consequence 
of [T7J Theorem 2]. It can be also easily checked directly. 

If dimAf < oo, then representations © and m as well as the correspond¬ 
ing criteria in parts (ii) and (iii) of Proposition 2] can be simplified by using 
the limiting version of the Frechet normal cones ©. If, additionally, X is a 
Euclidean space, then one can also make use of proximal normals. 

Recall (cf., e.g., [21]) that, in a Euclidean space, the limiting (Frechet) nor¬ 
mal cone to A at x and the proximal normal cone to A at a £ A are defined as 
follows: 


Na(x) := Limsup Na(o) = jx* = Amx k | x* k £ -/V^(afc), afe - 4 - xj , 

a^Xx 

fV^ rox (a) := cone (P^ 1 (a) — a) = {A(x — a) | A > 0, a £ P A (x)} . 


( 12 ) 

(13) 


Their usage is justified by the following simple observations: 

N'ff ox {a) C Na{cl) and N a(x) = Limsup N^ ox (a). (14) 

A _ 
a—tx 

Proposition 6. Let A and B be closed subsets of X. 

(i) Suppose dim AT < oo. 

Dual characterizations . 

9[A,B\(x) = inf {||u + x|| | u £ N A {x), v £ N B (x), ||u|| + ||u|| = 1} 

= liminf { ||u + u|| | u £ iVj( rox (a), v £ N^ mx (b), 
pio l 

a £ A nB p (x), b £ B flB p (i), ||u|| + ||u|| = l|. 


{A, B} is uniformly regular at x if and only if one of the following two 
equivalent conditions is satisfied: 


(a) N A (x)n(-N B (x)) ={ 0 }; 

(b) there exist positive numbers a and S such that inequality © holds 
true for all a £ A fl B^x), b £ B n B^x), u £ Nff ox (a), and v £ 
N% ox (b). 


(ii) Suppose X is a Euclidean space. 
Angle characterizations. 


c[A, B](x) = sup {— (u, v) | u £ Na(x) fl S, v £ N B (x) fl §} (15) 

= limsup { — (it, v) | u £ Njf ox (a) fl §, v £ Ng TOX (b) fl §, 
p4,o l 

a £ An M p (x), 6 £ B fl B p (x)|. 


{ A , B} is uniformly regular at x if and only if one of the following two 
equivalent conditions is satisfied: 
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(a) {(u, v) £ ( N A (x ) (~l S) x ( N b {x ) (~l §) I ( u,v ) = -1} = 0; 

(b) there exist numbers a < 1 and S > 0 such that inequality dill) holds 
true for all a £ An B^x), b £ B D ®i'(x), u £ N^ rox (a) fl §, and 
v £ N% ox (b) D S. 

Remark 7. 1. Condition (a) in part (i) of the above proposition is a ubiqui¬ 
tous qualification condition in optimization and variational analysis; cf. basic 
qualification condition | 21 j and transversality condition mm- 

2. If one replaces § with B in representation (fldl) . one will get nonnegative 
constant ©■ The relationship between the two constants is straightforward: 
c = max{c[A, B](x), 0}. 

2.2 Super-regularity 

In the next several subsections, we follow m and 010 , respectively. Although 
some definitions and assertions are valid in arbitrary Hilbert spaces, in accor¬ 
dance with the setting of [19] and [410 . we assume in these two subsections that 
X is a finite dimensional Euclidean space. 

Unlike the uniform regularity, the super-regularity property is defined for a 
single set. The next definition contains a list of equivalent characterizations of 
this property which come from [19[ Definition 4.3, Proposition 4.4, and Corol¬ 
lary 4.10], respectively. 

Definition 8. A closed subset A C X is super-regular at a point x £ A if one 
of the following equivalent conditions is satisfied: 

(i) for any 7 > 0 , there exists a 5 > 0 such that 

(x -x A ,a- x A ) < 7 II* - x a\\ ||a - x A \\ 
for all x £ Bi(x), x A £ P A {x ), and a £ A fl B^(x); 

(ii) for any 7 > 0 , there exists a 5 > 0 such that 

(u,x - a) < 7 ||u|| ||x- a|| (16) 

for all x, a £ A fl B^(x) and u £ N A {a ); 

(iii) for any 7 > 0 , there exists a 5 > 0 such that 

(v-u,y-x)> - 7 || y - x|| 

for all x, y £ A fl B^(x) and u £ N A (x) and v £ N A (y). 

Remark 9. 1. Super-regularity is a kind of local “near convexity” property, 
refining or complementing a number of properties of this kind: Clarke regularity 
urn, amenability [24], prox-regularity mm, and subsmoothness m ( cf - first 
order Shapiro property USD- For a detailed discussion and comparing of the 
properties we refer the reader to m- 
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2. Super-regularity of one of the sets is an important ingredient of the 
convergence analysis of projection methods following the scheme initiated in 
Lewis et al. [15]; cf. Theorems El and IM1 In fact, a weaker “quantified” version 
of this property corresponding to fixing 7 > 0 in Definition [ 8 ] (and Definition 1101 
below), i.e., a kind of 7 - super-regularity is sufficient for this type of analysis; 
cf. |5] Definition 8.1] and Definition 2] (The latter definition introduces 
a more advanced Holder version of this property.) Of course for alternating 
projections to converge, 7 must be small and the convergence rate depends on 
7 - 

2.3 Restricted normal cones and restricted super-regu¬ 
larity 

There have been several successful attempts to relax the discussed above reg¬ 
ularity properties by restricting the set of involved (normal) directions to only 
those relevant for characterizing alternating projections. 

The definitions of restricted normal cones to a set introduced in [5] take into 
account another set and generalize proximal and limiting normal cones m and 
m in the setting of a Euclidean space: 

jyB- P iox( a ) cone ((p- 1 ^) nB)—a), ( 17 ) 

N^(x) := Limsup A^^ _prox (a). (18) 

A _ 
a—>x 

Sets (1171) and (|18[) are called, respectively, the B-proximal normal cone to A at 
a £ A and B-limiting normal cone to A at x. When B is the whole space, they 
obviously coincide with (fl3l) and (fl^l) (cf. the representation of the limiting 
normal cone given by the equality in (fl4l) l. Note that cones m and m can 
be empty. 

Similarly to (1171) . one can define also the B-Frechet normal cone to A at 
a £ A: 


Wf (a) := Na(o) D cone (B — a) 

and the corresponding limiting one. The following inclusions are straightfor¬ 
ward: 


lVf- prox (a) C IVf (a) C N A (a). 

Definition 10. A closed subset A C X is B-super-regular at a point x £ A if, 
for any 7 > 0, there exists a S > 0 such that condition msD holds true for all 
x,a € A D B^(x) and u £ N^~ plox (a). 

Remark 11. As observed in [5], H-proximal normals in Definition 1101 can be 
replaced with H-limiting ones. Similarly, in Definition | 8 ](ii) and (iii), one can 
replace Frechet normals with limiting ones. 
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2.4 BLPW-restricted regularity 

The next definition introduces a modification of the property used in the an¬ 
gle characterization of the uniform regularity in Proposition H]dii). This new 
property and its subsequent characterizations and application in convergence 
estimate (Theorem[[5]) originate in Bauschke, Luke, Phan, and Wang [2JE]. We 
are going to use for the regularity property of a collection of two sets discussed 
below the term BLPW-restricted regularity. 

Definition 12. A collection of closed sets { A , B} is BLPW-restrictedly regular 
at x £ A D B if 

Ci [A, B] (x) := lim sup { — («, v) \u£ N A ~ prox (a) fl §, v £ N B ~ plox (b) D S, 
pio l 

a £ A n B p (i), b £ B fl B p (i)j < 1, (19) 

i.e., there exist numbers a < 1 and S > 0 such that condition EH holds for all 
a e dnij(i), i e fl nij(s), « e ivf prox (a) n§, and u e A^ _prox (6) n§. 

Proposition 13. (i) The following representation holds true: 

ci [A,B\{x) = sup | — (u, v) | u £ N A (, x ) fl S, v £ N B (x) fl § j . (20) 

(ii) If either N A ( 5)fl§ ^ 0 and N b (x)C\S ^ 0, or N A (x)nS = N^(x)r\S = 0, 
then 

c l [A,B](x) = l-Wl[A,B}{x), 

where 

§i[A 1 B\(x) = liminfj ||ti + u|| | u £ N A ~ pTOX (a), v £ N B ~ pTOX (b), 
a £ A n B p (i), b £ B fl B p (x), ||u|| + ||u|| = l| 

= inf |||u + c|| | u £ N B a (a), v £ N B (b), ||u|| + |M| = l|. 

(iii) A collection of closed sets { A , B } is BLPW-restrictedly regular at x £ 
An B if and only if one of the following conditions holds true: 

Ci := sup j— (u, v) | u £ N A (x) fl B, v £ N B (x) fl B j < 1, (21) 

9 1 [A,B}(x)> 0, 

Nl(x)n(-Ni(xj) C{0}. (22) 

Remark 14. 1. The difference between formula EH and definition of ci in 
EH is that, in the latter one, closed unit balls are used instead of spheres. 
As a result, ci is either nonnegative or equal — oo. (The latter case is possible 
because restricted normal cones can be empty.) At the same time, conditions 
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Ci[A, B](x) < 1 and C\ < 1 are equivalent and ci can be used for characterizing 
BLPW-restricted regularity. The inequality ci < c, where c is given by Q, is 
obvious. It can be strict; cf. 0 Example 7.1]. 

2. In [5], a more general setting of four sets A,B,A,B is considered with 
the A- and B-proximal and limiting normals cones in Definition [Inland Proposi¬ 
tion [13] replaced by their A and B versions. As described in [U Subsection 3.6], 
this provides additional flexibility in applications when determining regularity 
properties. To simplify the presentation, in this article we set A = A and B = B. 

3. Condition (1221) is referred to in [5] as (A, B)-qualification condition while 
constant (USD is called the limiting CQ number. 

Theorem 15. Let X be a finite dimensional Euclidean space. Suppose that 

(i) { A , B} is BLPW-restrictedly regular at x £ An B; 

(ii) A is B-super-regular at x. 

Then, for any c £ (ci, 1), a sequence of alternating projections for {A, B} with 
initial point sufficiently close to x converges to a point in An B with R— linear 
rate yfc. 


2.5 BLPW-DIL-restricted regularity 

The concept of BLPW-restricted regularity was further refined in Drusvyatskiy, 
Ioffe and Lewis US Definition 4.4]. We are going to call the amended property 
BLPW-DIL-restricted regularity. 

Definition 16. A collection of closed sets {A, B} is BLPW-DIL-restrictedly 
regular at x £ A fl B if 

c 2 [A, B}{x) := limsup { - ^ ^ | b a £ P B (a), a b £ P A (b), 

p! 0 l ||a — 0 o || ||6— a 6 || 

a £ (A \ B) fl B p (x), b £ (B \ A) fl B p (5)| < 1, (23) 
i.e., there exist numbers a < 1 and 6 > 0 such that 

- (a - b a , b - a b ) < a\\a - b a \\ \\b - a b \\ 

for all a £ (A\B) DB^i), b £ (B\A) flB^i), b a £ Pb(o .), and a b £ PA(b). 

Remark 17. The property in Definition [16] is referred to in [10] as inherent 
transversality. 

An analogue of Proposition [13] holds true with constant 0\[A, B](x) replaced 
by 


i[A,B]{x) = i liminf < 
l pto 


a — b a 


b- a b 


b a £ Pb(cl), a b £ P A {b), 


IIa-b a || II&-0&II 

a £ (A \ B) fl B p (x), b £ (B \ A) fl B p (a;) 
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and appropriate limiting objects. 

It is easy to see that a BLPW-restrictedly regular collection is also BLPW- 
DIL-restrictedly regular, but the converse is not true in general. 

2.6 DIL-restricted regularity 

The next definition and its subsequent characterizations originate in Drusvy- 
atskiy, Ioffe and Lewis m- We are going to use for the regularity property of 
a collection of two sets discussed below the term DIL-restricted regularity. 

Unlike [ID] , if not specified otherwise, we adopt in this subsection the setting 
of a general Hilbert space. 

Definition 18. A collection of closed sets {A, B} is DIL-restrictedly regular at 
x £ A fl B if 


§ 4 : \A. 1 B](x) := lim inf 

p !0 ae(A\B)nBp($), 6 e(B\A)nB p (S) 

m “{''(iFTT ,JVj< ” ) ) •''(iFTT ,JVfl( ' ,) )} >0 ’ (24> 

i.e., there exist positive numbers 7 and <5 > 0 such that 

m “{ d ( ii ^' iv ' 4 ( a ) )' < i ( iW ^’ A ' , ’ (i ’ ) )} >7 (25> 

for all a £ ( A \ B) fl (x) and b £ (B \ A) fl B 5 (x). 

Proposition 19. A collection of closed sets {A , B} is DIL-restrictedly regular 
at x £ An B if and only if 


£4 [A, B](x) := lim sup 
p4,o l 


min {(6 — a, u ), (a — b , i>)} 

\\a~b\\ 


u g Na(o) n §, 


v £ ./Vb(&) ns, a £ (A \ B) fl B p (a:), b £ (B\A)C\ B p (x)| < 1, (26) 


i.e., there exist numbers a < 1 and S > 0 such that 

min{(6 — a, u ), (a — b , w)} < a||a — b|| 

for all a £ (A\H)nBi(a;), b £ (B\ A)nB, 5 (x), u £ NA(a)nS, and v £ NB(b)nS. 
Moreover, (£ 4 [A, B](x)) 2 + ( 04 [A, B](x)) 2 = 1. 

Remark 20. 1. If dimX < 00 , then, as usual, the Frechet normals in (l24l) and 
EDI) can be replaced by the proximal ones: 


04 [A, B] (x) = lim inf 

ptO ae(A\B)nB p (x), be(B\A)nB p (S) 
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[A,B\{x) = limsup 


min{(6 — a, u) , (a — b , w}} 


| u £ IVj( rox (a) n S, 


||a- &|| 


v £ N^ TOX (b) fl S, a 


G (.A \ B) n B p (x), b G (B \ A) n B p (x)| 


2 . In [TO], the property in Definition 1181 is referred to as intrinsic transver- 
sality. 

The next two examples show that DIL-restricted regularity is in general 
independent of BLPW-DIL-restricted regularity. 

Example 21 (BLPW-DIL-restricted regularity but not DIL-restricted regularity; 
Figure [TJ. Define a function / : [0,1] —> K by 

( 0 , if t = 0 : 

f(t) : = ) -t + l/ 2 n +\ if t G (l/ 2 n+ 1 ,3/2 n+2 ], 

[ t - l/2 n , if t e (3/2 n+2 , l/2 n ], n = 0 , 1, ... 

and consider the sets: A = gph/ and B = {(t,t) : t € [0,1]} and the point 
x = (0,0) = A fl B in R 2 . Suppose R 2 is equipped with the Euclidean norm. 



Figure 1: BLPW-DIL-restricted regularity but not DIL-restricted regularity 


It is easy to check that / is a continuous function and consequently A is 
closed; /( 1 / 2 ") = 0 , /(3/2"+ 2 ) = -l/ 2 n + 2 , n = 0 , 1 ,... 

Take any a G A \ B, b G B \ A, b a 6 Pb{o), and ab £ Pa(&)- Thanks to the 
properties of the Euclidean distance, we have 

06 = ( 1 / 2 ", 0 ), 

b £ B n PX\a b ) = {(t,i) | * £ [3/2 n+ 2 ,3/2” +1 ]}, 
a — b a = k{\, — 1 ) 

for some n £ N and k > 0. Then, 


c?[A,B\{x)= max 

bGBnPX 1 (a b ) 


((~1 ; 1 ),b-a b ) 
V2\\b-a b \\ 



’ ll & - Of. 11 


b- a b 
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where b := (3/2 n+2 , 3/2 n+2 ), and consequently, 


c 2 [A, B}(x) 


<(-1,1), (-1,3)) 2 

V^-v/lO V5 


Hence, { A , £?} is BLPW-DIL-restrictedly regular at x. 

Given an n G N, we choose a := (1/2”, 0) G A\B and b := (l/2 n+1 , l/2 n+1 ) G 
B \ A. Then, 


N A° X ( a ) = N A{a) = {(ti,t 2 ) : t 2 > |H|}, 
N% ox (b) =N B (b) = K(l, —1), 


and consequently, 

a — b= l/2" +1 (l, —1) G N B (b)n-N A (a). 

It follows that C 4 [A,B](x) = 1 and {A, B} is not DIL-restrictedly regular at 
x. A 

Example 22 (DIL-restricted regularity but not BLPW-DIL-restricted regularity; 
Figure [2]). Consider two sets: 

A ={(t,0) : t > 0}U {(*,-*) : t > 0}, 

B ={(t,0) : t > 0}U{(t,f) : t > 0} 

and the point x = (0,0) G A D B in K 2 . Suppose R 2 is equipped with the 
Euclidean norm. 



Figure 2: DIL-restricted regularity but not BLPW-DIL-restricted regularity 

For any a = (ii, — ti) G A\B and b = (t 2 , t 2 ) G B \ A, we have 

N%°*{a) =N A (a) = R(l,l), 

N%° x (b) =N B (b) = R(l, — 1 ). 


and consequently, 


C 4 [A,B\(x) = sup 

ti>0,t 2 >0 


min{fi,f 2 } 1 ^ 1 
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Hence, {A, B} is DIL-restrictedly regular at x. 

For any a £ A\B, b £ B\A, b a £ Pg(a), and a b £ P A (b), we have 

b- a b _ b a - a 
|| 6 -a b || ||a- 6 J' 

It follows that c 2 [A, B](x) = 1 and { A , B} is not BLPW-DIL-restrictedly regular 
at x. A 

The next fact was established in pTj Proposition 4.5]. 

Proposition 23. //dimX < 00 , {A, B} is BLPW-DIL-restrictedly regular at 
x, and both sets A and B are super-regular at x, then { A , B} is DIL-restrictedly 
regular at x. 

Remark 24. The assumption of super-regularity of both sets in Proposition [231 
is essential. Indeed, in Example [21] {A, B} is BLPW-DIL-restrictedly regular 
and B is super-regular (in fact, convex), while A is not and {A, B} is not DIL- 
restrictedly regular. 

2.7 NR-restricted regularity 

The next step in relaxing both BLPW- and DIL-restricted regularity properties 
while preserving the linear convergence of alternating projections has been done 
in Noll and Rondepierre [22]. In what follows, the resulting property is called 
NR-restricted regularity. 

Definition 25. A collection of closed sets {A,B} is NR-restrictedly regular at 
x £ A fl B if 

c 3 [A,B}(x) := limsup | tt— —TTrrp—yir \a Y £ A,b £ P B {a{), a 2 £ P A {b) 

Pto l ||ai - o|| ||a 2 - o|| 

ai, 6 ,a 2 S B p (z), I < 1, 

i.e., there exist numbers a < 1 and S > 0 such that 

(ai - 6 , a 2 - b) < a||ai - &|| ||a 2 - 6 || 

for all ai £ A fl Ba(ai), b £ Pe(ai) D B b (x), and a 2 £ P A (b ) D B b (ai). 

Remark 26. 1. NR-restricted regularity property is not symmetric: NR-restric¬ 
ted regularity of {A,B} does not imply that {B, A} is NR-restrictedly regular. 

2. If {A,B} is BLPW- or DIL-restrictedly regular at x, then it is NR-res¬ 
trictedly regular at x and the second implication can be strict [22] Propositions 1 
and 2 and Example 7.6]. In fact, it is easy to check that NR-restricted regularity 
is implied by BLPW-DIL-restricted regularity. Example \TZ\ shows that NR-res¬ 
tricted regularity can be strictly weaker. 

3. Theorem remains valid if the assumption of BLPW-restricted reg¬ 
ularity is replaced by that of NR-restricted regularity and Ci is replaced by 
c 3 [A, B){x). 
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4. The property in Definition[25]is referred to in |22j as separable intersection. 

5. In [22], a more general Holder-type property with exponent w £ [0,2) 
is considered. Definition 1251 corresponds to that property with uj = 0. For the 
convergence analysis, the authors of [22 introduce also a Holder version of the 
superregularity property. 


3 Convergence for inexact alternating projec¬ 
tions 

In this section, we study two settings of inexact alternating projections under the 
assumptions of DIL-restricted regularity and uniform regularity, respectively, 
and establish the corresponding convergence estimates. 


3.1 Convergence for inexact alternating projections under 
DIL-restricted regularity 

Given a point x and a set A in a Hilbert space and numbers r £ (0,1] and 
<7 £ [0,1), the (t, a)-projection of x on A is defined as follows: 

P^{x) (a £ A | t\\x — a|| < d(x , A), d{x — a, Na(o)) < a\\x — a||} . (27) 

One obviously has P^’ cr ( x) = Pa(x) for any a £ [0,1). Observe also that the 
above definition requires a to be an “almost projection” in terms of the distance 
||x — a|| being close to d(x , A) and also x — a being an “almost normal” to A. 

Definition 27 (Inexact alternating projections). Given r £ (0,1] and a £ [0, 1), 
{x n } is a sequence of (r, er)-alternating projections for { A , Bj if 


X2n+1 £ F’s CT ( X2n) and X2n+2 £ Pa° {xzn+l) (n = 0, 1, . . .). 

The next statement is taken from Hi Theorem 5.3] where it is formulated in 
the setting of a finite dimensional Euclidean space. It is a version of the general 
metric space Basic Lemma from [12j . Recall that the (strong) slope [ 8 ] of y at 
a point u £ X with /(it) < +00 is defined as follows: 


|V/|(u) 


lim sup 

u' —tu,u' ^Lu 


f(u) - f(u') 
d(u', u) 


Lemma 28 (Error bound). Let X be a complete metric space, f : X —> R U 
{+ 00 } a lower semicontinuous function, x £ X with f{x) < +oo, 8 > 0, and 
a < f{x). Suppose that 


p := inf |V/|(u) > 

MgB 5 (x), a<f(u)<f(x) 


f 0) - 


( 28 ) 


Then S(f, a) := {u £ X \ f(u) < a} 0 and 


pd(x,S{f,a )) < f{x) - a. 


16 




If X is an Asplund space, then a standard argument based on the subdiffer¬ 
ential sum rule (cf., e.g., [Til Proposition 5(ii)] or [TDJ Proposition 6.9]) shows 
that the primal space slopes in the definition of p, in (1281) can be replaced by 
the subdifferential slopes: 


T = 


inf 

ICHjWi OL<f(u)<f(x) 


\df\(u). 


(29) 


Here 

\df\(u):= inf Jar*||*, 

x*£df(u) 

where df(u ) is the Frechet subdifferential of / at u and || • ||* is the norm on 
X* dual to the norm on X participating in the definition of the primal space 
slope. Note that in general |V/|(u) < \df\(u). 

If A is a finite dimensional Euclidean space, then, instead of the Frechet 
subdifferentials, one can use the proximal subdifferentials (3 prox /(u): 


T = 


inf 

ueBj(i),o</(ti)</(i) 


|d prox /|(u), 


(30) 


where 


\d^f\(u):= inf \\x* 
x*edv rox f(u) 


The next statement is a consequence of Lemma (28] It extends slightly EH 
Theorem 3.1]. 


Proposition 29 (Distance decrease). Let A be a closed subset of a Hilbert space 
X, a € A, b £ A, d > 0, and a < ||a — &||. Suppose that 


inf d (ir — t»’ n a(u))>o. 

u6An*j(o) \ u—6 / 

||u-6||<||o-6|| 


(31) 


Then d(b, A) < \\a — 6|| — p,S. 

If dim. X < oo, then the Frechet normal cones N a (u) in (1311) can be replaced 
by the proximal ones JVj( IOX (u). 

Proof. Consider the lower semicontinuous function / = d(-, b) + la, where la 
is the indicator function of A: c A (x) = 0 if x £ A and la(x) = +oo if x A. 
Then /(a) = ||a — 6|| and 

df(u) = ij—— JA+Na(u), \df\{u) = d(^- — ,N a (u)) 

||u-6|| Vl|w- & ll ) 

for any u £ A. It follows from the first part of Lemma [28] and representation 
((29l) that d(b,A) < a for any a £ (||a — 6|| — p6, ||a — 6||) and consequently, 
d(b, A) < ||a. — 6|| — p5. 

If dim A < oo, then instead of representation (1291) one can use representation 

®. □ 


17 





The next statement is essentially m Lemma 3.2]. 

Lemma 30. Any nonzero vectors x and y in a Hilbert space satisfy 


— z 


< 


\\x-y\\ 

IMI ' 


where - : = {TT§1T ’ TT^h) WIT is the P r °j ection °f ufj[ onRy. 
Proof. 


( \\x-y\\ 
\ llz/ll 



INI 2 ~ 2 (x, y) + ||y || 2 

\\y \\ 2 

]j^p(lMI 2 - 2 M 


1 + 


x y 

M’M 





> 0 . 


2 


□ 

Theorem 31 (Convergence of inexact alternating projections). Suppose that 
{A, B} is DIL-restrictedly regular at x, 0 < a < Oa[A, B](x) and 0 < r < 1. 
Then, for any 7 < O 4 [A, B](x) satisfying 0 < 7 — a < r and 

c := r -1 (l — 7 2 + 7 a) < 1 , 

any sequence of (r, a)-alternating projections for {A, B} with initial point suffi¬ 
ciently close to x converges to a point in A n B with R—linear rate c. 

Proof. By Definition [TH there exists a p > 0 such that condition (1251) holds true 
for all a £ (A \ B) D B p (i) and b £ (B\A)tl B p (x). 

Let a € An B p / (x) and b £ Pfj a (a) D B p / (x) where p' := p/(1 + 2(7 — a)). 
We are going to show that 

d(b,A) < (1 — 7 2 + 7 <t )||6 — a||. 


If b £ A, the inequality holds true trivially. Suppose b £ A and denote 6 := 
( 7 —ct)|| 6 —a||. Consider any point u £ AnB^(a). Since ||u—a|| < ( 7 —ct)|| 6 —a|| < 
r||6 — a|| < ds(a), we see that u £ B\ in particular, a (j B and u ^ b. Let z 
denote the projection of 011 ®-(a — &)• Then ||z|| < 1 and, employing 

Lemma l30l 


u — b 

||m- 6|| 


,JVb(6) < 


u — b 


< 


||m- 6|| 
u — a|| 
||&- a|| 


d(z, N B (b)) 


+ a < (7 — a) + a = 7 . 
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Since ||u —x|| < ||u — a|| + ||a — x|| < 2(y —a)p'+p' = p and \\b —x\\ < p' < p, we 
get from (1^51) that d ^ n^ZfcH 1 -/V^it)^ > 7- It follows from Proposition l29l that 
d{b : A) < ||a — 6|| — y<5 = (1 — 7 2 + ycr)||a — 6||. Hence, 

\\a! - 6|| < r~ 1 d(b, A) < c\\a - 6|| for all a G P^ a (b). (32) 

Now we show that any sequence {x n } of (t, aj-alternating projections for 
{A, B} remains in B p /(x) whenever xo G B p »(*) where p" := + 1^ p' < 

p'. Indeed, 

||*i - *o|| < T~ 1 d{x 0 ,B) < t~ 1 ||x 0 - x||. 

Let n G N and 27 - G B p / (x), k = 0,1,... n. It follows from (13211 that 

||*fc+i - 27-11 < c k \\xi - x 0 || (fc = 0,l,...n), (33) 

and consequently, 

n j 

\\x n+ i - xo|| < ^c fe \\xi - x 0 || < -||*i - x 0 [|, 

k =0 

||a:n+i - *|| < + 1 j H x ° _ s ll < p '- 

Thanks to (l33| . { 27 } is a Cauchy sequence containing two subsequences belong¬ 
ing to closed subsets A and B , respectively. Hence, it converges to a point in 
AflB with R —linear rate c. □ 

Remark 32. 1. When inexact alternating projections are close to being exact, 

i.e., r and a are close to 1 and 0, respectively (cf. definition (l27l) I. then the 
assumptions of Theorem mi are easily satisfied (as long as 0i[A,B\{x) > 0) 
while the convergence rate c = r _1 ( 1 — y 2 + yer) is mostly determined by the 
term 1 — y 2 . Recall that 7 can be any number in {Q,9^\A,B\{x)). Thanks to 
Proposition [lHJ 1 — y 2 = (y 7 ) 2 where y 7 can be any number in (64 [A, B\(x), 1). 

2. When dimX < 00 , the special case r = 1 and a = 0 of Theorem l3ll 
recaptures [101 Theorem 2.3]. The proof given above follows that of [TO] Theo¬ 
rem 2.3]. 

3. It can be of interest to consider a more advanced version of inexact 
alternating projections than the one given in Definition 1271 

x 2n +i G Pg’ ai (x 2 n) and x 2n+2 G PJ ?’* 3 (x 2 n +i) (n = 0,1,...), 

where ti,t 2 G (0,1] and ay, a 2 G [0,1). For instance, the projections on one of 
the sets, say, A can be required to be exact, i.e., t 2 = 1 and a 2 = 0. Theorem ED 
remains applicable to this situation with r := min{ri, t 2 } and <7 := max{cri, a 2 }. 
It is possible to obtain a sharper convergence estimate taking into account dif¬ 
ferent “inexactness” parameters for each of the sets. For that, one needs to 
amend the definition of alternating projections by considering the selection of 
the pair {x 2n +i,x 2n + 2 } as a single two-part iteration. 
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3.2 Convergence for inexact alternating projections under 
uniform regularity 

The motivation for the discussed below version of inexact projections comes 
from pH Section 6]. 

Given a point x and a set A in a Hilbert space and a number cr £ [0,1), the 
a-projection of x on A is defined as follows: 

Pj[(ir) := (a £ A \ d (x — a, Na(o)) < <r\\x — a||} . (34) 


Observe that 


P%{ x) = {a & A \ x — a £ Na(o)} 3 Pa(x) 

and the inclusion can be strict even in finite dimensions. Furthermore, for any 
cr £ [ 0 , 1 ), PJ( x) can contain points lying arbitrarily far from x. 

Definition 33 (Inexact alternating projections). Given a number cr £ [0,1), 
{x n } is a sequence of cr-alternating projections for {A,B} if 

X2n+1 £ -Pb(z 2 ti) and X2n+2 £ -PK^n+l), 

\\x n +2 - X n+ l\\ < \\x n +l - Xn\\ (n = 0, 1, . . .). (35) 

The role of the monotonicity condition (1351) in Definition 1551 is to compensate 
for the lack of good projection properties of the cr-projection operator (1341) . In 
the case of standard alternating projections (cf. Definition [lj , this condition is 
satisfied automatically. 

Theorem 34 (Convergence of inexact alternating projections under uniform 
regularity). Suppose that {A, B} is uniformly regular at x, A is super-regular 
at x and a £ [0,1) satisfies 

Co := c[A, -B](x)(l — a 2 ) + a 2 + 2o\J\ — a 2 + a < 1 . 

Then, for any c £ (co,l), any sequence {xk} of a-alternating projections for 
{A, B} with initial points Xg and X\ sufficiently close to x converges to a point 
in Ad B with R— linear rate y/c. 

Proof. Let c £ (co, 1) and choose a c\ > c[A, B](x) and a 7 > 0 such that 

ci(l — cr 2 ) + a 2 + (2 a + y)\/l — a 2 + a < c. (36) 

By Proposition |4jiii) and Definition [ 8 jii), there exists a <5 > 0 such that 

~(u,v) < ci||w|| ||u||, (37) 

(u,x - a) < 7 ||u|| ||a: - a|| (38) 

for all x, a £ A D Bj(i), b £ B D 8,5(2;), u £ Na(o) and v £ Nsib). 
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Let ai £ AflB^x), b £ Pg(ai) fl lj(i) and 02 £ P^(&) nBj(ar). We are 
going to show that 

||a 2 - b\\ < c\\b- ai||. (39) 

By definition (1M1) . for any e £ (0,1 — cr), there exist u £ fV^(a 2 ) and v £ 
Nb{J}) such that 

|| 6 —a 2 — u|| < (cr + e )||6 —a 2 || and || a i - b - u|| < (a + e)||ai - 6 ||. (40) 

Additionally, one can ensure that 

IM| < \J\ - (a + e) 2 || 6 - a 2 || and ||u|| < yj\ - (cr + e) 2 ||ai - 6 ||. (41) 

Indeed, take any u £ Na (a 2 ) satisfying the first inequality in (HU1) . If u = 0, 
the first inequality in (TUI) is satisfied too. Suppose u ^ 0 and consider u\ := 
(b — a 2 , u) - the projection of b — a 2 on Mu. Then 

|| 6 -a 2 || 2 = ||u 1 || 2 + || 6 -a 2 -u 1 || 2 , (42) 

||6 - a 2 - ui|| < ||6 - a 2 - u|| < (a + e )||6 - a 2 || (43) 


and there exists a t £ (0, 1 ] such that u 2 := tui satisfies 

||&- a 2 - u 2 \\ = (ct + e)||6- a 2 || (44) 

(thanks to the continuity of the function t 1 —> ||6 — a 2 — titi||). Hence, u 2 £ 
Na{(i- 2 ), vector u\ — u 2 is a projection of b — a 2 — u 2 on Ku, i.e., 

||6 — a 2 - u 2 || 2 = ||ui - u 2 || 2 + \\b — a 2 - ui|| 2 , (45) 

and, using (1421) . (l45|) . (l44l) . and (l43l) . 


IMI = IMI - ||ui -u 2 || 


= VIM a 2 1| 2 - ||6- a 2 - ui|| 2 - V( a + £ ) 2 \\ b - M 2 - || b - a 2 - ui|| 2 

(l-(a + £ ) 2 )||6-a 2 || 2 

yj\\b- a 2 || 2 - || 6 - a 2 - ui|| 2 + y/(a + e) 2 ||&- a 2 || 2 - ||6 - a 2 - ui|| 2 


^ (l-(<7 + £ ) 2 )||6-a 2 || 2 

~~ - (cr + £) 2 || 6 - a 2 || 


V 1 - (cr + £) 2 ||6 — a 2 11. 


Similarly, given any v £ Nsib) satisfying the second inequality in (1401) . one 
can find a u 2 £ Ns(b) satisfying this inequality and, additionally, the second 
inequality in (14T1) . 

Making use of (E3, m and m, we get 


— (b — a 2 , ai — b) = — (u, v) — (u, a± — b — v) 

— {b — a 2 — u, v) — (b — a 2 — it, a\ — b — v) 

< ci||w|| ||u|| + ||u|| ||ai -b-v || 

+ ||6 - a 2 - u|| IMI + ll & - 0 , 2 - u|| ll«i - b - u|| 

— ( c l(l — (<7 + £) 2 ) + 2(fJ + £)(\/l — (cr + £) 2 ) 
+ (cr + e) 2 ) ||6 — a 2 1 | ||ai- 6 ||. 
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At the same time, making use of (1551) and the first inequalities in (HOI) and (PHI) , 
we have 


(b — 02 , ai — a 2 ) = (u, ai — a 2 ) + (b — a 2 - u, ai — a 2 ) 

< 7 IMI IK - a 2 1| + (a + e)||6 - a 2 || ||ai - a 2 || 

< ( 7 V 1 - ( cr + e) 2 + 0 + e))||&- a 2 || ||ai -a 2 ||, 

Adding the last two estimates and passing to limit as e 0, we obtain 

II&- a 2 || 2 < (ci(l - a 2 ) + a 2 + (2a + 7)^1 - a 2 + a') ||6 - o 2 || ||oi - 6 ||. 
Thanks to HMD, this proves (1391) . 

Now we show that a sequence {x n } of cr-alternating projections for {A,B} 
remains in B^x) if xo,Xi G B p (x) where p := Let n G N and 

xk G 85 ( 5 ), k = 0,1,..., 2n. It follows from (l39l) that 

||x 2fc - X 2 k-i\\ < c fe ||xi - rc 0 || (k= 1,2, (46) 

and consequently, employing also ED, 

\\x 2 n+2 ~ Soil < \\X2n+2 - X 2n +l\\ + \\x2n +1 - ®o|| < || X 2 n+2 ~ X 2 n+l\\ 
n 

+ (ll^fc+i X 2 k\\ + \\X2k ~ X 2 k-l\\) + \\Xi ~ X 0 || 
k= 1 
n 

<2^ II X 2 k - £ 2 fc-i|| + 2 ||xi - xoll 
fc= l 

" 2 

< 2V'c fc ||xi - x 0 || < --||ari - x 0 ||. 

z —' 1 — c 

k=0 

Thus, 


max{||x 2n+2 


x||, ||x 2n+ i - x||} < max{||x 2n+2 - x 0 ||, ||x 2 „+i - x 0 || 
2 

+ IK - 5|| < -r ^~||xi - x 0 || + ||x 0 - x|| 


1 — c 


< 


1 — c 


||xi -x|| 


c ||x 0 - x11 < I —-p = (5, 


1 — c 


1 — c 


i.e., x 2 „+i,x 2n+2 G Ba(x). 

Thanks to (1551) . {x*,} is a Cauchy sequence containing two subsequences 
belonging to closed subsets A and B , respectively. Hence, it converges to a 
point in A D B with R —linear rate \fc. □ 

Remark 35. 1. When the “inexactness” parameter er is small (cf. definition 
ED), then the assumptions of Theorem [34] are easily satisfied (as long as 
c[A,B](x) < 1 and condition (1351) holds) while the convergence rate is close 
to the one guaranteed by Theorem [2] and [19] Theorem 6.1]. 
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2. One can also consider a more advanced version of inexact alternating 
projections than the one given in Definition 1331 

X2n+1 & Pb 1 (, x 2n) and X 2n +2 £ P^ 2 (x 2 n+l), (n = 0, 1, . . .). 

where ay, <72 £ [0,1). Theorem 1341 remains applicable to this situation with 
<t := max{(7i, 172 } (cf. Remark 1321 31. 

3. Observe that, thanks to (1331) . for odd values of n, condition (1351) is 
improved in the proof of Theorem 1341 

\\x n +2 - Zra+lll < C\\x n+ i - X n ||, 

where c < 1. However, the assumption is still needed to ensure that x n +2 is not 
too far from x and uniform and super-regularity conditions are applicable.. 

4. Constant ci in (E3 is an upper estimate of the cosine of the angle ip 
between vectors u and — v while er + e in (1401) can be interpreted as an upper 
estimate of the sine of the angles 1 and %p 2 between vectors 6 — 02 and u 
and a\ — b and v, respectively. One can use standard trigonometric identities 
and inequalities (1371) and (1501) to obtain an upper estimate of the cosine of the 
angle p — %l>i — ^2 between vectors 6—02 and b — a 1 and possibly improve the 
convergence estimate in the statement of Theorem [34] 

5. If both subsets A and B are super-regular, then in the proof of Theo- 
rem[34l one can establish an analogue of (l39l) with subsets A and B interchanged: 

||&2 - a|| < c||a — 6 i||, 

where b\ £ B D Bj(i), a £ PJ( 61 ) D B^x) and 62 £ Pb (a) 0 Ba(x). This 
guarantees an improvement with rate c on each iteration. As a result, one 
obtains a better overall R —linear rate c. 

6 . The conclusion of Theorem [37] remains true if one replaces the assump¬ 
tions of uniform regularity of {A, B} (and the regularity constant c[A,B\(x)) 
and super-regularity of A with BLPW-restricted regularity (and the regular¬ 
ity constant c\[A,B]{x)) and R-super-regularity, respectively, accompanied by 
appropriate adjustments in the definition of cr-projections. 
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